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[57] ABSTRACT 

A man-machine interface which provides tactile feedback to 
various sensing body parts is disclosed. The device employs 
one or more vibro tactile units, where each unit comprises a 
mass and a mass-moving actuator. As the mass is accelerated 
by the mass-moving actuator, the entire vibrotactile unit 
vibrates. Thus, the vibrotactile unit transmits a vibratory 
stimulus to the sensing body part to which it is affixed. The 
vibrotactile unit may be used in conjunction with a spatial 
placement sensing device which measures the spatial place- 
ment of a measured body part. A computing device uses the 
spatial placement of the measured body part to determine the 
desired vibratory stimulus to be provided by the vibrotactile 
unit. In this manner, the computing device may control the 
level of vibratory feedback perceived by the corresponding 
sensing body part in response to the motion of the measured 
body part. The sensing body part and the measured body part 
may be separate or the same body part. 

24 Claims, 20 Drawing Sheets 
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TACTILE FEEDBACK MAN-MACHINE 
INTERFACE DEVICE 

This is a continuation of application Ser. No. 08/565,102, 
filed Nov. 30, 1995 now abandoned. 
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TECHNICAL FIELD 

This invention relates to a man-machine interface and in 
particular to an interface that provides tactile sensation to a 
user. 

BACKGROUND OF THE INVENTION 

"Virtual reality (VR) is an immersive environment which 
is created by a computer and with which users have real- 
time, multisensorial interactions. Topically, these interac- 
tions involve some or all of the human senses through either 
visual feedback, sound, force and tactile feedback (i.e. 
reflection), smell and even taste. The key to immersive 
realism is the capacity of the user to use his/her hand to 
interactively manipulate virtual objects. Unfortunately, the 
majority of existing commercial virtual reality systems use 
hand-sensing devices that provide no hap tic feedback. 
Nevertheless, some efforts have been made to provide means 
for presenting force and tactile information to the user's 
hand. By force information, it is meant the application of a 
set force to a selected part of the hand, for example, a finger. 
By tactile information, it is meant the application of a 
stimuli, e.g., a vibration, to a selected part of the hand, e.g., 
a fingertip pad. This stimulus, could simulate surface texture 
or dynamic conditions at the contact, for example. A few 
examples of existing force reflecting devices are the EXOS 
SAFiRE™, the Master II Hand Master device at Rutgers 
university, the PERCRO Force-Reflecting Hand Master and 
the Sarcos TOPS Force-Reflecting Hand Master. Some 
tactile feedback devices that have been developed include 
the PERCRO Position-Sensing and Tactile Feedback Hand 
Master and the EXOS IbuchMaster™. 

Virtual reality is not the only field where it is desirable to 
feed back force and tactile information to a human user/ 
operator. Another common area is telerobotics. Some of the 
devices mentioned above are also often used as telerobotics 


10 


15 


20 


25 


30 


interfaces. Some examples in the literature of feedback 
devices designed more specifically for telerobotics include 
the tactile shape sensing and display system developed by 
Kontarinis et al., the voice -coil based tactile feedback device 
used by Patrick et al. and the pin-based tactile display array 
developed by Kaczmarek and Bach-y-rita. Other applica- 
tions for a vibrotactile unit of the subject invention include, 
but are not limited to, gesture recognition, music generation, 
entertainment and medical applications. 

In an ideal case, it would be desirable to provide full force 
and tactile feedback to a user to make the virtual reality or 
telerobotic experience as realistic as possible. Unfortunately, 
most force feedback devices are cumbersome, heavy, expen- 
sive and difficult to put on and remove. Many of the tactile 
feedback solutions are also cumbersome, complex and frag- 
ile. Additionally, some of the tactile feedback devices 
described in the literature, such as small voice coils mounted 
to directly contact the skin, tend to numb the skin after only 
a few seconds of operation and then become ineffective as 
feedback devices. 

SUMMARY OF THE INVENTION 

An object of the invention is a man-machine interface 
which may be employed in such areas as interactive com- 
puter applications, telerobotics, gesture recognition, music 
generation, entertainment, medical applications and the like. 
Another object of the invention is a mass which is moved by 
a "mass-moving actuator" which generates a vibration that 
a user can feel. Yet another object of the invention is the 
generation of an activating signal to produce the vibrations 
either as a result of the user's state or as a result of 
environmental conditions, whether virtual or physical. Still 
another object of the invention is vibrating the bone struc- 
35 ture of a sensing body part, as well as skin 
mechanoreceptors, to provide feedback. Yet still another 
object of the invention is the complex actuation of vibratory 
devices. 

The tactile sensation that a user feels is generated by a 
40 vibrotactile unit mounted on, or in functional relation to, a 
sensing body part of a user by a fastening means. In one 
embodiment, the vibrotactile device comprises a mass con- 
nected eccentrically to a mass-moving actuator shaft (i.e. the 
center of mass of the mass is offset from the axis of rotation). 
45 Energizing the mass-moving actuator causes the shaft to 
turn, which rotates the eccentric mass. This rotating mass 
causes a corresponding rotating force vector. A rapidly 
rotating force vector feels to the user as a vibration. A slowly 
rotating force vector feels like a series of individual 
impulses. For a small number of rapid rotations, the rotating 
force vector feels like a single impulse. We will use the term 
"vibration" to denote a change in force vector (i.e., direction 
or magnitude). Examples of vibrations include, but are not 
limited to a single impulse, a sinusoidal force magnitude, 
and other functions of the force vector. We use the term 
"tactile sensation" to refer to the feeling perceived by a user 
when their sensing body part experiences vibrations induced 
by a vibrotactile unit. 

A signal processor interprets a state signal and produces 
an activating signal to drive the mass-moving actuator, The 
variable components of the state signal may be physical 
(e.g., measured), or virtual (e.g. simulated, or internally 
generated); they may vary with time (e.g., the state variables 
may represent processes); and they may be integer-valued 
65 (e.g., binary or discrete) or real-valued (e.g., continuous). 
The signal processor may or may not comprise a computer 
which interprets and further processes the state signal. The 
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signal processor comprises a signal driver which produces 
an activating signal supplying power to, or controlling the 
power drawn by, the vibrotactile unit. The power may be, but 
is not restricted to, electric, pneumatic, hydraulic, and com- 
bustive types. The driver may be, but is not restricted to, an 
electric motor controller comprising a current amp and 
sensor for closed loop control, a flow valve controlling the 
amount of a pressurized fluid or gas, a flow valve controlling 
the amount of fuel to a combustion engine and the like. The 
details of such a signal processor and mass-moving actuator 
are common knowledge to someone skilled in the art. 

The state signal may be generated in response to a variety 
of conditions. In one embodiment, one or more sensors 
measuring physical conditions of the user and/or the user's 
environment may generate one or more components of a 
physical state signal. In another embodiment, a computer 
simulation may determine the one or more components of a 
virtual state signal from a simulated (e.g., virtual) state or 
condition. The virtual state may optionally be influenced by 
a physical state. The virtual state includes anything that a 
computer or timing system can generate including, but not 
restricted to, a fixed time from a previous event; the position, 
velocity, acceleration (or other dynamic quantity) of one or 
more virtual objects in a simulation; the collision of two 
virtual objects in a simulation; the start or finishing of a 
computer job or process; the setting of a flag by another 
process or simulation; combinations of situations; and the 
like. The virtual state signal is a machine-readable measure- 
ment of the virtual state variables. 

The physical state signal is measured from physical state 
variables. These variables have relevance to the physical 
state of a body part of the user or the user's physical 
environment. The physical state variables includes any mea- 
surable parameter in the environment or any measurable 
parameter relating to a body part of the user. Some examples 
of measurable physical parameters in an environment 
include but are not restricted to, the state of a body part, the 
position of objects in the environment, the amount of energy 
imparted to an object in the environment, the existence of an 
object or objects in the environment, the chemical state of an 
object, the temperature in the environment, and the like. The 
state of a body part may include the physical position, 
velocity, or acceleration of the body part relative to another 
body part or relative to a point in the environment. Hie state 
of a body part may also include any bodily function, where 
the measured state signal may include the output from an 
electroencephalograph (EEG), electrocardiograph (ECG), 
electromyograph (EMG), electrooptigraph (EOG) or eye- 
gaze sensor, and sensors which measure joint angle, heart 
rate, dermal or subdermal temperature, blood pressure, 
blood oxygen content (or any measurable blood chemical), 
digestive action, stress level, voice activation or voice 
recognition, and the like. The user's voice may constitute a 
measured physical state variable, where his spoken words 
are sensed and/or recognized to generate a corresponding 
activating signal. The physical state signal is a machine- 
readable measurement of the physical state variables. 

Hie state signal is presented to the signal processor which 
interprets the state, and then determines how and when to 
activate the vibrotactile units accordingly. The signal pro- 
cessor produces an activating signal which may be in 
response to an event it interprets from the state signal. 
Examples of events include contact, gestures, spoken words, 
onset of panic or unconsciousness, and the like. The inter- 
pretation of the state signal may or may not be a binary 
event, i.e. the simple changing of state between two values. 
An example of a binary event is contact vs. non-contact 
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between two virtual or real objects. The process of inter- 
preting may include any general function of state variable 
components. The interpretation function may produce an 
output control value which is integer or real-valued. A 
non-binary-valued interpretation output typically relates to 
the signal processor producing a non-binary activation sig- 
nal. 

By varying the functional form of the activation signal, 
the type of feedback that the vibrotactile device generates 
may also be varied. The device may generate a complex 
tactile sensation, which is defined to be a non-binary signal 
from a single or multiple vibrotactile units. Examples of 
complex tactile sensations include (1) varying the amplitude 
of vibration with a profile which is non-uniform over time; 
(2) varying the frequency of vibration; (3) varying the 
duration of impulses; (4) varying the combination of ampli- 
tude and frequency; (5) vibrating two or more vibrotactile 
units with a uniform or non-uniform amplitude profile; (6) 
sequencing multiple vibrotactile units with different ampli- 
tude or frequency profiles; and the like. 

The frequency and amplitude of the vibration or impulse 
may be changed by modifying the activating signal to the 
mass-moving actuator. The frequency and amplitude may 
also be controlled by increasing the mass or by changing the 
radius of gyration (e.g. changing its eccentricity). For 
example, the mass may be changed by pumping fluid into an 
eccentrically rotating container. The sense of frequency that 
the user perceives may be changed independently of the 
amplitude by modulating the power to the vibrotactile unit 
at a variable frequency. This technique is called amplitude 
modulation, which is common knowledge to those skilled in 
the art. This change in frequency and amplitude may be used 
to convey complex, compound or other forms of information 
to the user. 

Sensors may be mounted on the vibrotactile unit or the 
sensing body part to determine the frequency and amplitude 
of vibration sensed by the user. A feedback control loop may 
be added which uses this information to more tightly control 
the frequency and amplitude, or to reach peak efficiency at 
the resonant frequency of the collective vibrating device - 
body system. 

Examples of a sensing body part on which the vibrotactile 
unit may be mounted, or in functional relation to the 
vibrotactile unit, include, but are not limited to: the distal 
part of a digit, the dorsal (back) side of a phalanx or 
metacarpus, palm, forearm, humerus, underarm, shoulder, 
back, chest, nipples, abdomen, head, nose, chin, groin, 
genitals, thigh, calf, shin, foot, toes, and the like. A plurality 
of vibrotactile units may be disposed on or near different 
sensing body parts, and may be activated in unison or 
independently. 

Each vibrotactile unit may be affixed to the body by a 
fastening means. The fastening means is defined to be the 
means of attaching the vibrotactile unit to a sensing body 
part, transmitting (and possibly modifying) the vibrations 
created by the vibrotactile unit. This means may be one that 
is flexible such as a strap made of cloth or soft polymer, or 
rigid, such as metal or hard polymer which grabs or pinches 
the flesh, skin or hair. The fastening means may also include 
gluing or taping to the skin or hair, or tying with a string or 
rope around a limb, or attaching to clothes with Velcro® or 
similarly functional means. A vibrotactile unit may also be 
attached to another structure which is then attached to the 
body part with the same means just mentioned. The vibra- 
tions generated by the actuator may be transmitted to the 
sensing body part by the structure (rigid or non-rigid), or 
through a linkage transmission or a fluid transmission. 


03/10/2004, EAST Version: 1.4.1 


6,088,017 

5 6 

The eccentric mass need not be mounted directly onto a simulation, an array of vibrotactile units may vibrate in 

motor shaft. A mechanical transmission may rotate the mass sequence to correspond to a pressure wave hitting the 

on a different shaft than the motor shaft. The mass-moving corresponding parts of the body; the amplitude of the 

actuator rotates this shaft. Fluids such as air and liquids may vibration may vary to correspond to different levels of 

also transmit the motion from a power source to the rotating 5 pressure being simulated. A user may also feel a virtual 

eccentric mass. Changing magnetic fields may also be object that comes into contact with a portion of his virtual 

employed to induce vibration of a ferrous mass. body. The user may feel a virtual bug crawl up his virtual 

As previously mentioned, state signals may relate to a arm by sequencing an array of vibrotactile units. To accom- 

physical or virtual state. When the state represents a physical pany the tactile sensations received by the user which are 

condition, the subject invention includes a state measure- 1Q uncorrelated with his actions, the user may be presented with 

ment sensor which produces a state signal. This state mea- visual, auditory, taste, smell, force, temperature and other 

surement sensor may measure some property of the sensing forms of feedback in order to enhance the realism of the 

body part. Recall that the body part associated with receiv- simulated environment. 

ing the vibrotactile stimulation is called the sensing body \ n yet another application of the vibrotactile device, a 

part, the body part associated with producing the activating 15 group of users may receive tactile sensations. In one 

signal is called the measured body part. The signal processor example, users may wear individual vibrotactile units, or 

may receive signals from this sensor such as a tactile, they may also share vibrotactile units as follows. A tactile 

position, bend, velocity, acceleration or temperature sensor sensation may be shared by one or more users making 

and generate an activating signal. In this way, the user may physical contact with the sensing body part of another user, 

receive feedback based on his actions or physical state. For 2Q p or example, one user may wear vibrotactile units on the 

example, the vibrotactile device may be used to train the backs of his fingers. A second user, not wearing any vibro- 

user to do some physical motion task. In this case, the tactile units, may obtain vibrotactile feedback transmitted 

position or motion of the body part which is to do the motion v j a the first user when the first user places the palmar side 

task is measured by the state measurement sensor and is also 0 f hi s fingers on a sensing body part of the second user. The 

the sensing body part. Direct stimulation to the body part M activating signal for each vibrotactile unit may be computer 

being trained enhances the training of the task. Complex controlled via either user's actions or through a computer 

actuation in the form of a function of different levels of simulated event. In a second example, a group of users may 

frequency or amplitude may inform the user whether his eacn receive identical tactile feedback through individually 

actions are correct or incorrect; the level of correctness may mounted vibrotactile units. The common activating signal 

correspond to the level of frequency or amplitude. 30 may correspond to measured body parts from a single, 

In addition, the sensing body part (which is also the optionally separate, user. Different users may also be respon- 

measured body part) may have a graphical representation sible for producing the common activating signal for one or 

shown to the user. The user may also be presented with more vibrotactile units. For instance, the movement of one 

visual, auditory, taste, smell, force and/or temperature cues user's arm may control the vibrotactile unit on each user's 

to his actions in combination with the vibrotactile cues 35 arm; and the voice of a second user may control the 

provided by the subject invention. The user may be vibrotactile unit on each user's back; the eye-gaze of three 

immersed in a virtual environment. The user may see a other users may control the vibrotactile unit upon which they 

graphical representation of his/her body part interact with stare in unison. An example application of a single user 

virtual objects and simultaneously feel a corresponding controlling many user's vibrotactile sensations is a new form 

tactile sensation simulating the interaction. For example a 40 of entertainment where a performer creates vibrotactile 

user may have his/her fingers be the sensing and measured sensations for an audience. 

body parts. The user may then see his/her virtual hand in the i n a preferred embodiment, the vibrotactile units are 

virtual environment contact a virtual object. The user would affixed to an instrumented glove, such as the CyberGlove™ 

then feel an increasing vibratory stimulation on his/her manufactured by Virtual Technologies of Palo Alto, Calif., 

physical fingertip as he increased the virtual pressure on the 45 tjsa. The CyberGlove has sensors in it which measure the 

virtual object using the virtual fingertip. an gi es of the joints of the hand. The fingertips of the 

As previously discussed, using the vibrotactile device of CyberGlove are open so that the user may reliably handle 
the subject invention, a user may receive tactile sensations physical objects while wearing the glove. The open finger- 
based on the state of his body parts. In the previous case the tips allow the user to feel the sensations of real objects in 
state included the position, and other dynamic quantities, of 50 conjunction with the generated vibrotactile sensations. The 
the body parts. In certain applications, the measured body fingertips need not be open, they may be fully enclosed as 
part is the same as the sensing body part (the list of possible in the 22-sensor model of the CyberGlove. The mass- 
sensing body parts mentioned earlier also applies to mea- moving actuator of each vibrotactile unit is encased in a 
sured body parts); in other applications they are different cylindrical housing and mounted onto the glove on each of 
body parts. When the measured body part is different than 55 the fingers and thumb, and on the palmar side of the hand, 
the sensing body part, the subject invention acts as a Each mass-moving actuator is composed of a small DC 
coupling device which relates the sensing body part and the motor with an eccentric mass mounted rigidly onto the shaft 
measured body part. of the motor. The casing is made of tubular plastic and serves 

In another application, the user may receive tactile feed- to protect the motion of the mass from the user and protect 

back as a result of the conditions of a computer simulated 60 the user from the rotating mass. The casing may be made of 

environment, not necessarily related to the user's actions or any rigid or semi-rigid material including but not limited to 

state. The vibrotactile units with varying actuation levels steel, aluminum, brass, copper, plastic, rubber, wood, 

may be used to simulate a variety of contact situations, e.g., composite, fiberglass, glass, cardboard, and the like. The 

contact with fluids and solids, and contacts which are casing may form a solid barrier, a wire-mesh, grid or 

momentary or continuous. For example, a user immersed in 65 column-like support capable of transmitting vibrations from 

a computer simulated virtual environment may feel simu- the mass-moving actuator to the fastening means. The 

lated fluid (like air or water) across his body. In such a instrumented glove informs a computer of the position of the 
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user's hand and fingers. The computer, which is part of the 
signal processor, then interprets this hand state signal (and 
any virtual state signal if the application calls for it). The 
computer then generates a control signal, which when pro- 
cessed by the driver, activates the actuators to create tactile 
sensations. 

One feature of the embodiment of the subject invention 
just described, which employs an eccentric mass, is that the 
energy imparted into the system can be less than the energy 
required when using electromagnetic coils (such as the 
speaker voice coils used by Patrick et al. and the EXOS 
TouchMaster). Energy is stored as rotational inertia in the 
eccentric mass, whereas the voice-coil-based systems lose 
all inertial energy each time the coil change directions. 

Another feature of the subject invention is that vibrating 
the bone structure of a body part, as well as skin 
mechanoreceptors, has an advantage over stimulating just 
the skin mechanoreceptors (such as Meissner, Merkel, 
Ruffini and Pacinian corpuscles) in that the nerves do not get 
easily overstimulated and do not become numb. In addition, 
the form of information to the user is closer to a physical 
contact sensation where the muscles and joints are 
stimulated, as is done by full force feedback systems. As a 
result, the vibrotactile units need not be attached to a body 
part which has sensitive skin mechanoreceptors. For 
example, a vibrotactile unit may be attached to a fingernail 
or an elbow. 

In an embodiment in which a user is immersed in a 
computer simulated environment, actuation of vibrotactile 
units can approximate the sensation of touching physical 
objects as full force feedback devices do. The deep impul- 
sive sensation in the muscles and joints generated by the 
vibrotactile units simulates the change in proprioceptive 
state as the user touches a virtual object. The subject 
invention provides numerous advantages over a sustained 
force feedback device. For example, because of its 
simplicity, the vibrotactile device of the subject invention 
can be made smaller, lighter, less encumbering, more 
robustly and cheaper. 

The subject invention may be used in combination with a 
sustained force feedback device as provided by Kramer in 
U.S. Pat. No. 5,184,319, Kramer in U.S. patent application 
Ser. No. 08/373,531 (allowed), Zarudiansky in U.S. Pat. No. 
4,302,138, Burdea in U.S. Pat. No. 5,354,162, and Jacobus 
in U.S. Pat. No. 5,389,865. These patents and patent appli- 
cations are incorporated herein by reference. Such a com- 
bination can give a higher frequency response than that 
capable of being generated by the sustained force feedback 
device and/or to reduce the cost and/or size of the full 
system. The subject invention may also be used in combi- 
nation with other tactile feedback devices such as heating or 
cooling devices, bladder devices or voice coils. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. la is a perspective view of an electric mass-moving 

actuator with an eccentric mass attached to its shaft, 
FIG. 16 is a perspective view of a mass-moving linear 

actuator with a mass attached to its shaft. 

FIGS. 2a and 26 are a cross-sectional side view and a 

perspective view respectively of an example of a vibrotactile 

unit. 

FIG. 3 is a perspective view of the vibrotactile unit shown 
in FIG. 2b where the vibrotactile unit is attached to the 
palmar side of the fingertip. 

FIG. 4 is another perspective view of a vibrotactile unit 
attached to the dorsal side of the fingertip, where it makes 
contact with the nail. 
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FIG. 5 is a perspective view of a vibrotactile unit attached 
to the dorsal side of the proximal phalanx. 

FIG. 6 is a perspective view of a vibrotactile unit attached 
to the palm of the hand 
5 FIG. 7 is a perspective view of a vibrotactile unit attached 
to the dorsal side of the metacarpus (the back of the hand). 

FIG. 8 is a perspective view of a vibrotactile unit attached 
to the top of the foot. 
1Q FIG. 9 is a side view of a multitude of vibrotactile units 
attached to a variety of places on the head. 

FIGS. 10a and 106 are front and back views respectively, 
of a multitude of vibrotactile units attached to a variety of 
places on the body. 
15 FIGS. 11a and 116 are perspective and front views 
respectively of a fastening means where the palmar side of 
the fingertip receives greater stimulation without the vibro- 
tactile unit getting in the way of manipulation. 
FIGS. 12a and 126 are perspective and front views 
20 respectively of a fastening means where the palmar side of 
the fingertip receives greater stimulation without the vibro- 
tactile unit getting in the way of manipulation. 

FIG. 13 is a perspective view of a fastening means where 
no casing is required for the vibrotactile unit because the 
25 moving mass is mounted away from the finger thus reducing 
the possibility of interference. 

FIG. 14 is a side view of an another fastening means 
where no casing is required for the vibrotactile unit because 
the moving mass is mounted away from the finger thus 
30 reducing the possibility of interference. 

FIG. 15 is a perspective view of a fastening means where 
the vibrotactile unit is attached to the body via a spring that 
is used to alter the amplitude and frequency of the sensed 
35 oscillations. 

FIGS. 16a, 166 and 16c are front schematic views and 16d 
is a perspective view of a vibrotactile unit where the radius 
of the gyration of the eccentric mass increases as the angular 
velocity of the shaft increases. FIGS. 16a, 166, and 16c 
40 illustrate the principle, where w 2 >w 1 >0. 

FIG. 17 is a schematic electrical-mechanical signal propa- 
gation diagram. 

FIGS. 18a and 186 show an instrumented glove, in this 
case the Virtual Technologies CyberGlove™, with both 
45 position sensors and vibrotactile units. 

FIGS. 19a and 196 show schematically two applications 
using a sensing glove with vibrotactile units attached to the 
fingers and back of the hand. FIG. 19a shows a virtual reality 
application. FIG. 196 shows a telerobotic application. 
50 FIG. 20 illustrates schematically an example of a virtual 
environment with separate sensing and measured body parts. 

FIGS, 21a and 216 are perspective drawings showing two 
applications of the invention for gesture recognition. In FIG. 
21a, the gesture is static and in FIG. 216, the gesture is 
55 dynamic (the index finger is moving in a pre-determined 
fashion). 

FIG. 22 is a schematic drawing showing a musical appli- 
cation. 

60 FIG. 23 is a schematic drawing showing an entertainment 
or relaxation application. 

FIG. 24 is a schematic drawing showing a medical 
application. 

FIGS. 25a, 256 and 25c are a schematic drawings illus- 
65 trating an amplitude decoupling method. 

FIG. 26a is a perspective drawing and FIG. 266 is a side 
view of a vibrotactile unit with a controllable eccentricity. 


03/10/2004, EAST Version: 1.4.1 


6,088; 

9 

FIG. 26c is an alternative transmission method that can be 
used to control the eccentricity of the mass. 

FIG. 27 is an exemplary diagrammatic view of an appli- 
cation comprising the vibrotactile device, a virtual simula- 
tion and a physical simulation, 5 

DETAILED DESCRIPTION OF THE DRAWINGS 

FIG. la shows one embodiment of a vibrotactile unit 
obtained by attaching an eccentric mass (101) to the shaft 
(102) of a small d.c. electric motor (100) which serves as the 10 
mass-moving actuator. Here the mass is pie -shaped, how- 
ever any other shape which offsets the center of gravity from 
the axis of rotation, and thus provides eccentricity, may be 
used. This eccentricity causes the force vector to change 
directions during rotation and thus induces vibrations in the 15 
unit. The mass may be made of any material like steel, 
aluminium, plastic or fluid encased in a container, to name 
a few. 

FIG. lb shows another embodiment of a vibrotactile unit 2Q 
obtained by attaching a mass (103) to the shaft (104) of a 
linear mass-moving actuator (105). Here the mass is disk- 
shaped, however any other shape may be used. The linear 
actuator moves the mass back and forth and thus induces 
vibrations in the unit by suddenly accelerating and deceler- 2$ 
ating it. The mass may be made of any material like steel, 
aluminium, plastic or fluid encased in a container, to name 
a few. 

FIG. 2a and FIG. 2b are cross-sectional and perspective 
drawings respectively of an example of a casing (200) in 30 
which a mass-moving actuator (202) and a mass (201) are 
contained. Again, the eccentric mass (201) is attached to the 
shaft (204) of the electric motor. The casing has a hole for 
the motor leads (203) to escape. The casing protects the 
moving mass from being disturbed by the user. It also 3S 
protects the user from being hit by the mass. The casing may 
be made from any rigid material, or variety of materials, 
such as aluminum, steel, plastic, glass, glass fiber composite 
etc. It is typically desirable to have a small light weight 
mass-moving actuator, mass, casing and fastening means so 40 
that the device may be as unencumbering as possible. From 
here on, this embodiment of the invention will serve as the 
sample vibrotactile unit used in many of the subsequent 
figures. 

FIG. 3 illustrates one fastening means for attaching the 45 
vibrotactile unit to a finger. In this example, the vibrotactile 
unit (300) is attached directly to the palmar side of the 
fingertip using a fastening means (301). The fastening means 
may be made of either flexible material, such as cloth, fabric, 
tape, Velcro® or a soft polymer, or it may be made of a rigid 50 
material such as a metal, hard polymer or wood, to name a 
few. The fastening means need not encircle the finger 
entirely, it may grab the finger by clamping or pinching, or 
by sticking to it such as with glue or tape. Also, if the user 
is wearing a glove, the vibrotactile unit may also be sewn 55 
onto the glove or bonded to it and need not be affixed 
directly to the hand. This will also be the case in the 
following figures which illustrate various ways to position 
the vibrotactile unit on the human body. 

FIG. 4 illustrates another way of mounting the vibrotactile 60 
unit (400) onto the finger using a fastening means (401). In 
this case the unit is positioned directly above the fingernail 
on the dorsal side of the fingertip (the sensing body part) in 
order to provide a distinctive tactile sensation, or vibratory 
stimulus. The unit may vibrate the nail, the flesh underneath 65 
and the bone with sufficient amplitude that the sensation is 
felt throughout the finger, not just locally at the skin. 
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FIG. 5 illustrates another way of mounting the vibrotactile 
unit (500) onto the finger using a fastening means (501). In 
this case the unit is positioned on the dorsal side of the 
proximal phalanx. Since the unit gives sensation throughout 
the entire finger, touching virtual objects with the palmar 
side of the hand will still give sensations to that side even 
though it is mounted on the back. When used in conjunction 
with manipulating physical objects with the palmar side, the 
vibrational sensation on the palmar side is enhanced. These 
features are not limited to the proximal phalanx. Mounting 
to the dorsal side of any phalanx or limb will produce the 
same effect. 

FIG. 6 illustrates another way of mounting the vibrotactile 
unit (600) onto the user using a fastening means (601). In 
this case the unit is positioned in the palm of the user's hand. 
If a glove (instrumented or not) is worn, then the unit may 
also be mounted inside or outside of the glove in a pocket- 
like cavity, and need not be explicitly affixed to the hand. 

FIG. 7 illustrates another way of mounting the vibrotactile 
unit (700) onto the user using a fastening means (701). In 
this case the unit is positioned on the dorsal side of the 
metacarpus, or the back of the hand. Again, if a glove 
(instrumented or not) is worn, then the unit may also be 
mounted inside or outside of the glove in a pocket-like 
cavity, and need not be explicitly affixed to the hand. 

FIG. 8 illustrates another way of mounting the vibrotactile 
unit (800) onto the user using a fastening means (801). In 
this case the unit is positioned on the top of the user's foot. 
If a sock-like garment (instrumented or not) is worn, then the 
unit may also be mounted inside or outside of the garment 
in a pocket-like cavity, and need not be explicitly affixed to 
the foot. 

FIG. 9 illustrates another way of mounting vibrotactile 
units (900) onto the user. In this example, the units are 
positioned on the user's head. If a hat-like garment 
(instrumented or not) is worn, then the units may also be 
mounted inside or outside of the suit in pocket-like cavities, 
and need not be explicitly affixed to the body. Examples of 
locations include, but are not limited to, the temples (900), 
the forehead (901), the top of the head (902) and the back of 
the head (903). 

FIG. 10a illustrates another way of fastening vibrotactile 
units (1000-1012) onto the user. In these examples the units 
are positioned all over the front and the side of the user's 
body. If a body suit (instrumented or not) is worn, then the 
units may also be mounted inside or outside of the suit in 
pocket-like cavities, and need not be explicitly affixed to the 
body. By actuating a combination of actuators, the percep- 
tion of the localization of the tactile sensation may be 
controlled. For example, if the actuators on the forearm 
(1007) and on the humerus (1005) actuate with equal 
intensity, the user may have the perception that there is a 
single source of sensation originating in-between the two. 
This may apply to any combination of vibrotactile units 
located anywhere on the body. This effect is also apparent 
when multiple vibrotactile units are activated in sequence. 
There is a perception that a single vibration has "moved" 
between the activating vibrotactile units. The vibrotactile 
units displayed in the figure show examples of a variety of 
candidate positions for attaching the units. Some of these 
positions include, but are not limited to, the forehead (1000), 
the shoulders (1001), the side of the arm (1003), the humerus 

(1005) , the chest (1002), the nipples (1004), the abdomen 

(1006) , the forearm (1007), the groin (1008), the hips 
(1009), the thighs (1010), the knees (1011) and the shins 
(1012). 
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FIG. 106 illustrates another way of fastening vibrotactile FIG. 14 shows another vibrotactile unit and fastening 

units (1020-1028) onto the user. In these examples the means where no casing is required for the mass-moving 

vibrotactile units are positioned all over the back of the actuator/mass assembly. A small rigid or semi-rigid structure 

user's body. If a body suit (instrumented or not) is worn, (1404) elevates the vibrotactile unit above the middle pha- 

then the vibrotactile units may also be mounted inside or $ lanx in such a way that the finger cannot interfere with the 

outside the body suit in pocket-like cavities, and need not be rotation of the eccentric mass (1402) about the main axis of 

explicitly affixed to the body. The vibrotactile units dis- the shaft (1403) of the mass-moving actuator (1401). The 

played in the figure show examples of a variety of candidate structure (1404) is attached to the middle phalanx using a 

positions for attaching the units to the body. Some of these strap (1405) which can be rigid or flexible and which can be 

positions include, but are not limited to, the back of the head either an integral or separate part of the structure. 

^°?° ) ',^i aSe °l th f n V^ ( 1° 21) ' bet , W ^ th ! s * ou } de l FIG. 15 shows yet another vibrotactile unit (1500) and 

blades (1022) the back of the humems (1023) the back of fasteni means such mat the vibrolactile U[lit is connected 

aO2<0,the back of the thighs (1027) and the calves (1028)^ ^ 4^ fr £ m * perceived vibrations. A 
The vibrotactde units in FIG. 106 may be combined with which can be a flexible or ri id memb rane holds 
those in FIG. 10a as well. This plurality of vibrotactile units lt , ^ v . / . , if n ^ 6 . . lt 
shows one way that complex tactile sensations may be me S *™Z fin f ?P™B chan & s * c 
generated with multiple vibrotactile units. na t tural fifP»ncy of the vibrotactile unit Alternatively the 
FIGS. 11a and 116 show a vibrotactile unit mounted in vibrotactile umt/spnng apparatus could be attached below 
such a way that the fingertip may be stimulated without the finger instead of above it. The spring may also be 
unit getting in the way of manipulation with the fingers. FIG. 20 replaced by some form of actuator to agam control the 
11a shows a perspective view of the invention and FIG1 116 amplitude and frequency and/or to extend the range of 
shows a frontal view. A structure (1102), which may be amplitude and frequency. In addition a damper may be 
opened or closed at the end, surrounds the fingertip. The introduced in combination with the spring or actuation 
fastening means is comprised of three parts: part one affixing system to further control and/or extend the amplitude and 
the finger to the structure; part two affixing the vibrotactile 25 frequency of the perceived vibrations. An electro- 
unit to the structure; part three is the structure (1102). Part Theological fluid may used in the damper to control the 
one of the fastening means (1103), which can be a flexible damping term in the mechanical system, 
or rigid membrane, holds the finger against the structure on FIGS. 16a, 166, 16c, and 16d illustrate a modification to 
the palmar side of the fingertip. This part can be adjustable, the way the eccentric mass is mounted to a shaft. The radius 
fixed, flexible or stretchable. In part two, the vibrotactile unit 30 of the gyration K of the eccentric mass increases as the 

(1100) is mounted atop the structure, away from the palmar angular velocity of the shaft increases. The top three draw- 
side of the fingertip, using a means (1101) which can be a ings (FIGS, 16a, 166, 16c) illustrate the principle, where w 2 
flexible or rigid membrane. In this manner, the vibrations >Wj>0, and the bottom perspective drawing (FIG. 16d) 
from the vibrotactile unit may be transmitted through the provides an implementation. In FIG. 16a", a structure (1601) 
structure directly to the palmar side of the finger to provide 35 is attached the shaft (1602) of the mass-moving actuator 
a greater stimulation of the nerves local to the palmar side. (1600). The structure comprises a spring (1604) and mass 
In another embodiment, the structure (1102) and the vibro- (1603) assembly. At one end, the spring is attached to the 
tactile unit casing (1100) can be made of one part, thus inside of the structure and at the other end it is attached to 
eliminating the need for a part two of the fastening means the mass. The mass is free to move towards and away from 

(1101) . 40 the shaft inside a guide in the structure. The radius of 
FIGS. 12a and 126 show the vibrotactile unit mounted gyration K is the distance between the center of gravity of 

such that the fingertip can be stimulated without the unit the mass (1603) and the main axis of the mass-moving 

getting in the way of manipulation with the fingers. FIG. 12a actuator shaft (1602). As the angular velocity of the shaft 

shows a perspective view of the invention and FIG. 126 increases, the centrifugal forces felt by the mass increase, 

shows a side view. A structure (1202) is attached to the 45 causing it to stretch the spring further and increase the radius 

palmar side of the fingertip. The fastening means is com- of gyration. This apparatus minimizes the angular inertia of 

prised of three parts: part one, affixing the finger to the the device at start-up and then gradually increases the 

structure; part two, affixing the vibrotactile unit to the eccentricity of the mass so that larger vibrations can be 

structure; part three which is the structure (1202). Part one obtained at higher angular velocities. This relieves the stress 

(1203) may be a flexible or rigid membrane. This part may 50 on the bearings that hold the shaft and reduces the larger 

be adjustable, fixed, flexible or stretchable. In part two, the initial torque required to initiate rotation (as opposed to the 

vibrotactile unit (1200) is mounted atop the structure, away torque required to maintain rotation). Alternatively, the 

from the palmar side of the fingertip, using a means (1201) passive spring may be replaced by an active device which 

which can be a flexible or rigid membrane. In another controls or sets the radius of gyration of the mass. The active 

embodiment, the structure (1202) and the vibrotactile unit 55 device may comprise a shape memory alloy actuator or any 

casing (1200) can be made of one part, thus eliminating the other mechanism capable of controlling the position of the 

need for part two of the fastening means (1201). mass. 

FIG. 13 shows a vibrotactile unit and fastening means FIG. 17 shows how the electrical and mechanical signals 
where no casing is required for the mass-moving actuator/ propagate through the tactile feedback control system in a 
mass assembly. A small rigid or semi-rigid structure (1302) 60 preferred embodiment of the invention. The embodiment 
elevates the vibrotactile unit above the fingertip in such a shown employs a d.c. servo motor (1701) as the mass- 
way that the finger cannot interfere with the rotation of the moving actuator of a vibrotactile unit. A computer (1707), or 
eccentric mass (1301) about the main axis of the shaft (1304) other signal processing means, sends a digital value repre- 
of the mass-moving motor (1300). The structure (1302) is sentiug the desired actuation level control signal to the 
attached to the fingertip using a strap (1303) which can be 65 digital-to-analog convert, D/A(1703). The analog output of 
rigid or flexible and which can be either an integral or the D/A is then amplified by a variable gain amplifier (1704) 
separate part of the structure. to produce an analog voltage activation signal. This voltage 
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is placed across the servo motor, driving the motor at a computer (1904) which in turn sends the appropriate com- 

desired angular velocity. The voltage signal may alternately mands to the robot. Robot position and contact information 

be converted to a current activation signal for driving the (1910) is then fed back to the computer as the state signal, 

motor at a desired torque. Velocity damping of the servo The computer interprets this signal and decides what kind of 

control loop may be performed by tachometer feedback (not 5 vibrational feedback should be sent to the vibrotactile unit 

shown). The computer (1707), digital-to-analog converter (1901) (other vibrotactile units not shown) on the user via 

(1703), analog-to-digital converter, AJ D (1702), bus (1709) the vibrotactile unit driver (1903). Force or pressure sensors 

and variable gain amplifier (1704) may be elements of a may be mounted on the gripper instead of contact sensors, 

signal processor. Digitized values from A/D (1702) from The user then receives vibrational feedback of varying levels 

analog joint angle sensors (1705) provide the position infor- 10 depending on the force or pressure on the object. This allows 

mation of the fmgers (measured body parts) to the computer a teleoperator to perform tasks more efficiently and safely, 

as a physical state signal. In a virtual environment especially in handling delicate objects that would break 

application, the physical state signal may cause motion in a under certain grip forces. The user does not necessarily need 

corresponding virtual hand. If one of the digits of the virtual to control the robot or the objects of contact in order to use 

hand is found to be intersecting a virtual object, the com- 15 the tactile feedback. The vibrotactile device may act simply 

puter calculates the virtual force to be applied to the virtual to inform the user of contact with the object whether or not 

digit using knowledge of the virtual object's shape and as a result of the user's actions. 

compliance. The computer then causes an activation signal FIG. 20 illustrates an embodiment in a virtual reality 

to be sent to the vibrotactile units mounted on the user's context where the measured body part (2003) is the foot, 

fingers (sensing body part) to convey tactile information 20 however, the vibrotactile unit (2001) is mounted on the 

about that virtual force. Strain gage, fiber optic, finger which acts as the sensing body part (2002). The foot 

potentiometric, or other angle sensors may be used as analog has a graphical object (2004) associated with it in the 

joint angle sensors (1705). Strain gage angle sensors are computer simulation. In this case, the graphical object looks 

disclosed in the Kramer et al. U.S. Pat. Nos. 5,047,952 and like a foot as well. Motions of the foot are sent to the 

5,280,265, which patents are incorporated herein by refer- 25 computer (2008) via the body sensor interface (2006) and 

ence. are reflected on the computer monitor (2009). When the 

FIG. 18a and FIG. V&b illustrate a preferred embodiment computer (2008) determines that the graphical foot (2004) 

of the invention. An instrumented glove (1820) such as the contacts a virtual object (2010), the computer interprets this 

Cyber Glove™ manufactured by Virtual Technologies of state signal and sends a control signal to the vibrotactile unit 

Palo Alto Calif., USA, has sensors (1807-1819) on it which 30 driver (2007) to activate the vibrotactile unit (2001) on the 

measure the angles of the joints of the hand (the measured finger. This may be due to the user moving his foot so that 

body parts). In the figures, the fingertips of the glove are the graphical foot contacts (2005) the virtual object, or the 

open so that the user may handle physical objects while virtual object moving into the graphical foot independent of 

using the glove. This allows the user to feel the tactile the user's actions. The user then needs to correlate the 

sensations of real objects which may then be used in 35 contact of the virtual object with the sensation at the 

conjunction with tactile sensations generated from the sub- fingertip. While this does not seem as natural as vibrating the 

ject invention. The vibrotactile units (1801-1806) are foot as it makes contact, this illustrates the sensing body part 

encased in cylindrical housings and fastened to the glove on separate from the measured body part. This is necessary if 

each of the fmgers (1801-1804), the thumb (1805) and on the measuring body part cannot coincide with the sensing 

the palmar (1806) side of the hand. The vibrotactile units are 40 body part, for example if the measured body part is the 

composed of a d. c. motor (item 202 in FIG. 2) with an eye-ball or if the measured body part is on another user, 

eccentric mass (item 201 in FIG. 2) mounted onto its shaft FIG. 21a and FIG. 2\b illustrate a glove (2101) which 

(item 204 in FIG. 2). The casing is made of tubular plastic contains both position sensors and vibrotactile units (2100). 

and serves to protect the motion of the mass from the user The Virtual Technologies CyberGlove™ is an example of a 

and protect the user from the rotating mass. 45 glove with appropriate position sensors. The sensors mea- 

FIG. 19a shows a user wearing a sensing glove (1900) sure the spacial placement of the hand and fingers. A 

which can measure hand formations as well as the spatial computer uses gesture recognition software to determine if 

placement of the hand. The sensing glove has vibrotactile a pre-specified hand formation or motion has been gesticu- 

units (1901) fastened to the fingers and to the back of the lated. In FIG. 21a, the vibrotactile unit signals the user that 

hand. The user receives visual feedback through a graphical 50 a particular static pose has been detected. A different vibro- 

representation of his hand on the computer monitor (1908). tactile sensation can be generated in response to a recog- 

The computer (1904) receives the state signal (information nized moving hand or arm gesture that includes dynamic 

about the spatial placement of the user's hand) through the motions (FIG. 2\b), This may also be useful in training the 

sensors mounted on the glove via a glove sensor interface gesture recognition software for the gestures to be recog- 

(1902). When the virtual graphical hand (1906) touches 55 nized. In training the software, a user must repeatedly make 

(1907) a virtual object (1905) on the monitor, the computer the same gesture to obtain some sort of average position 

sends a control signal to the vibrotactile unit driver (1903) since humans cannot repeat gestures exactly. With the vibro- 

which then sends the activation signal to the vibrotactile tactile feedback, the user may be trained to better repeat his 

units (1901). gestures while at the same time training the recognition 

In a similar setup, FIG. 19b shows the same glove (1900) 60 software to recognize his gestures. Better repetition of the 

and computer interface remotely controlling a robotic arm gestures reduces the statistical distribution of the sensor 

(1911) instead of a graphic display. The robot has contact readings for a given hand gesture which in turn may improve 

sensors on its gripper (1912) that detect when the robot the performance of the recognition system, 

touches physical objects (1913). The user controls the robot FIG. 22 illustrates vibrotactile units in a musical appli- 

arm through the sensors on the glove which produce position 65 cation. The units are attached to a body suit or mounted 

readings of the fingers (measured body parts) which are sent directly onto the user's clothing. Different regions on the 

to the glove interface device (1902) and then outputted to the body (220G-2210), which contain groupings of vibrotactile 
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units (2211), may correspond to different musical instru- 
ments in an orchestra and serve to enhance the musical 
experience. For example, music produced by a cello pro- 
duces proportional vibrations on the user's thigh (2204) 
through the vibrotactile units located in that body region. 5 
Similarly, the drums induce vibrations in the units that 
stimulate the chest area (2201) and so on. Sections of the 
body containing multiple vibrotactile units corresponding to 
one instrument type may have individual vibrotactile units 
corresponding to individual instruments. For example, the 10 
cello section of the body is shown to have the first chair cello 
on the upper thigh, and the second chair cello on the lower 
thigh. The user may either be a passive listener "feeling" the 
instruments as well, or he may be an active participant in 
creating the music, receiving the vibrotactile sensations as 15 
feedback. 

FIG. 23 illustrates an entertainment application. In this 
case an array of vibrotactile units simulates water flow or 
wind. In this illustration a user is lying on a couch (2300) 
and is immersed in a virtual beach scene and sees the beach 20 
through a head-mounted display (2302). The user hears 
ocean sounds through head-mounted earphones (2301) and 
feels warmth from the sun through heat lamps (2303). The 
user then feels wind simulated by the vibrotactile units as 
they are pulsed in sequence creating "waves" of sensation. 25 
For example, the wind could flow from head to toes by 
alternatively pulsing the vibrotactile units starting with the 
ones on the head (2304) and ending with the ones on the toes 
(2305). Similarly, water is felt as pulsed waves (although 
perhaps of larger amplitude), as the user swims through the 30 
virtual water. In this fashion, the user may be relaxed or 
entertained. 

FIG. 24a and FIG. 24b illustrate a medical application 
where, for example, a user has injured a knee. A vibrotactile 
unit (2401) is used in conjunction with bend sensors (2400) 
mounted on the knee during physical therapy sessions as 
shown in FIG. 24c. The vibrotactile unit notifies the user 
when the knee is exercised appropriately and alerts the user 
if the knee is flexed further than a safe limit prescribed by 
a doctor and thus improve recovery as is illustrated in FIG. 40 
24b, Furthermore, the vibrotacttie units, in conjunction with 
other sensors, may be used in any biofeedback application. 

FIGS. 25a, 25b and 25c illustrate an approach for decou- 
pling the amplitude and frequency components of the vibra- 45 
tions generated by an eccentric mass-based vibrotactile unit. 
In this embodiment, the vibrotactile unit comprises a rotary 
electric motor (2501), a mass mounted eccentrically (2500), 
a sensor (2503) mounted on the shaft (2502) to determine the 
angular position of the shaft and a closed-loop control $Q 
system. Any other control law may be used that achieves a 
single rotation of the shaft. One example is shown in FIG. 
25a. The vertical axis of the graph represents a normalized 
current, the horizontal axis represents the rotation of the axis 
in radians. This corresponds to the following non-linear 55 
control law: 


(6£9>p) 
/— 1, (ji^0^2ji-6) 

/-o, c-6>e>6) 


35 


60 


With the initial conditions set so that the velocity is zero 
and rotational position of the mass, 6, (in radians) is equal 
to a small value, 6, (FIG. 256) sending current, I, to the 
motor in this manner would cause the mass to accelerate for 65 
half of a full rotation, up to 0+6 (FIG. 25c), and decelerate 
for the other half of the rotation coming to a stop between 


the -8 and +8 position in the ideal case. The actual position 
of the -6 and the +8 position may have to vary depending 
on the bandwidth of the control loop and the friction and 
damping of the system. The magnitude of vibration or 
impulse is set by the amplitude of the current, the frequency 
is set by repeating the above control at the desired frequency. 
A simple feedback control loop (PID for example) could 
ensure the initial conditions are correct before each pulse. 
The details of this are common knowledge to those skilled 
in the art. 

FIG. 26a is a perspective drawing and FIG. 26b is a side 
view of a vibrotactile unit with controllable eccentricity. A 
structure, such as a slip-disk (2602), is mounted on the shaft 
(2601) and is free to slide back and forth along the shaft. The 
slip-disk is attached to a linkage (2605) which connects it to 
the eccentric mass (2604). A positioning device (2603) 
controls the position of the slip-disk on the shaft, which in 
turn affects the position of the mass (via the linkage) and 
thus its eccentricity. FIG. 26c is an alternative transmission 
method that can be used to control the eccentricity of the 
mass. In FIG. 26c, the transmission comprises element 
(2606), which may be a flexible membrane or fluid inside a 
hollow shaft (2601) that is connected to the eccentric mass 
(2604) at one end and the sliding slip-disk (2602) at the 
other. Again, controlling the position of the disk along the 
shaft using the positioning device (2603) affects the eccen- 
tricity of the mass. Element 2606 may also be a fluid and 
2604 a hollow container. As the fluid is forced through the 
tube (2601) by the slip-disk (2602), or by some other 
pressure generating means, the container (2604) is filled 
with the fluid, thus, increasing the effective radius of gyra- 
tion of the center of mass of the fluid. By increasing the 
radius of gyration, by whichever means, it is possible to 
independently control the amplitude and frequency of vibra- 
tion of the vibrotactile unit. 

FIG. 27 provides an exemplary block diagram of the 
components and functional relationship between the com- 
ponents comprising the vibrotactile device when used in an 
application. Although some components are shown interre- 
lated with a unidirectional arrow, the arrows may be bidi- 
rectional to provide bidirectional flow of information. Addi- 
tional arrows may be added between blocks to provide for 
communication between components. An application may 
include presenting vibrotactile sensation to a body part of a 
user, where the vibrotactile sensation is associated with a 
virtual environment simulation (virtual simulation) and/or 
the physical state of a body (physical simulation), which 
may be the user's body, or another person's body. One or 
more virtual simulations may co-exist with one or more 
physical simulations, and may be combined with further 
types of simulations to yield a vibrotactile sensation. 

The exemplary virtual simulation (2722) of FIG. 27 
comprises a computer (2706) with computer monitor (2709). 
To produce the virtual simulation, the computer typically 
generates, processes, executes or runs a computer simulation 
(2705) which is typically in the form of a computer software 
program. In the exemplary virtual simulation, the computer 
produces a graphical display of a virtual measured body part 
on the monitor, where the body part is shown to be a 
fingertip (2707) on a virtual hand (2708). The virtual simu- 
lation may internally generate an internal state with a variety 
of state variables which comprise a virtual state signal 
(2703) to provide to a signal processor (2700). Exemplary 
virtual state variables include position, velocity, 
acceleration, mass, compliance, size, applying force or 
torque, composition, temperature, moisture, smell, taste and 
other dynamical, structural, physical, electrical metabolical, 
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moodal, cognitive, biological and chemical properties of a wire (e.g., electrical or optical), computer bus or other 

various portions internal to, and on the surface of, a virtual electrical or optical connecting means to a computer (2706) 

measured body part. States variables may also denote func- running a computer simulation (2705) in software. The 

tions of state variables, such as contact of various parts of the fingertip position is often provided in the form of digital 

virtual hand. 5 values, typically as joint angles and/or values corresponding 

FIG. 27 also provides an exemplary physical simulation t0 the six possible spatial degrees of freedom. The fingertip 

(2723) comprising a state sensor (2718) and a physical position may also be in the form of an analog voltage, 

measured body part (2717). In this example, the physical ™* computer simulation uses the physical state signal 

measured body part is depicted as a fingertip (2717) on a £720 ^rresponchng to the physical fingertip position 

u • iu * * *u u • i (2719) to simulate the position and motion of a virtual hand 

Physical^^ 2708 and fingertip (2707). The computer simulation dis- 

state (2719) of the physical measured body part and pro- V ^ ^ ^ ^ J {2m) fn 

duces a physical state signal (2720) to provide to me signal addition tQ Splaying a second virtual object whose 
processor (2700). The physical state signal (2720) is option- attributes may correspond to a second physical measured 
ally provided to the computer (2706) and/or computer object, such as a block, baU, car interior, engineering part, or 
simulation (2705) of a virtual simulation (2722). Exemplary 15 otner object. The computer monitor may be a desk-top 
physical state variables include position, velocity, monitor, head-mounted monitor, projection monitor, holo- 
acceleration, mass, compliance, size, applying force or graphic monitor, or any other computer generated display 
torque, composition, temperature, moisture, smell, taste and means. The second physical measured object may also be a 
other dynamical, structural, physical, electrical, metabolical, body part of the user or a second user, 
moodal, cognitive, biological and chemical properties of 20 When the user moves his hand, producing a movement of 
various portions internal to, and on the surface of, a physical the virtual hand, the computer simulation detects a level of 
measured body part. States variables may also denote func- virtual contact between the virtual fingertip (2707) and the 
tions of state variables, such as contact of various parts of the second virtual object. The computer simulation then pro- 
physical hand. duces a virtual state signal (2703) where one state variable 
As shown in FIG. 27, for both the virtual simulation and 25 denotes the level (e.g., amount of force) of the virtual 
the physical simulation, the signal processor (2700) receives contact . of ^ virtual fingertip. Tne virtual state signal is 
a state signal and produces an activating signal (2704). For transmitted to the signal processor (2721) via a wire (e.g., 
the virtual simulation, the state signal is the virtual state or °P Ucd )> com P uter bu * or other Metrical or 

signal (2703); for the physical simulation, the state signal is °? tical ^X^u t ^ t T tT ? i ™ 

* , v . /' . *\ /--- n -v tU ,. the computer (2706), in which case the vutual state signal is 

the physical state signal (2720). When the application com- 30 typically transmitted via the computer bus. When the signal 

pnses both a virtual simulation and a physical simulation, processor exists in a enclosure from the computer, 

both a virtual state signal and a physical state signal may be ^ virtual state signal is typically transmitted via a wire, 

presented to the signal processor. ^ signal pr0 cessor may convert the state variable level 

The signal processor may employ a digital or analog 0 f virtual contact into an activating signal voltage propor- 

computer (2701) to interpret one or more input state signals 35 tional to the level of virtual contact force using a digital-to- 

(e.g,, a virtual or physical state signal) and produce a control analog converter followed by an operational amplifier. The 

signal (2721) which becomes the input signal to a driver voltage is presented to the mass-moving actuator (2710) 

(2702). Using the control signal, the driver produces the typically by a wire (e.g., electrical or optical) or other 

activating signal (2704). When the computer is absent from electrical or optical connecting means. The mass-moving 

the signal processor, the driver determines the activating 40 actuator may be a variable speed electric motor which spins 

signal from the state signal or signals. Whether or not the eccentric mass (2711) on its shaft (2712). Hie electric motor 

computer is present in the signal processor, the activating with eccentric mass are housed in a plastic housing or casing 

signal is provided in a form for use by the mass-moving which is affixed to the dorsal portion of the instrumented 

actuator (2710). For example, the driver may comprise a glove surrounding the fingertip, which fingertip corresponds 

motion control module, an operational amplifier, a transistor, 45 to both the physical measured body part and the sensing 

a fluidic valve, a pump, a governor, carburetor, and the like. body part. The affixing is typically done with straps, sewing, 

In the case where the mass-moving actuator is an electric gluing and the like. As the eccentric mass rotates, the electric 

motor, the activating signal may be a voltage or current with motor, mass, casing and sensing body part all vibrate, 

sufficient electrical power or current drive to cause the motor typically at a common frequency. Ideally, there is little 

to turn. 50 vibrational attenuation between the mass and the sensing 

In FIG. 27, the mass-moving actuator (2710) is shown to body part such that as the eccentric mass rotates, the electric 

be an electric motor which turns a shaft (2712) and an motor, mass, casing and sensing body part all vibrate with 

eccentric mass (2711). As the mass is rotated, the entire the same amplitude. 

assembly of 2710, 2711 and 2712 vibrates, producing vibra- In the application just described, the user may perceive a 
tions (2713). Such vibrations are transmitted to a sensing 55 cause -and-effect relationship between motion of his finger- 
body part of a user who perceives a tactile sensation. In the tip and the level of vibration he feels. Thus, the position, 
figure, the sensing body part is exemplified as the fingertip compliance, mass, shape and other attributes of a virtual 
(2715) of a hand (2714). object may be detected by movement of the user's fingertip, 

An exemplary application which comprises a virtual or by movement of the virtual object, inducing various 

simulation and a physical simulation is summarized as 60 vibro tactile responses. The vibrotactile device of the subject 

follows: invention promotes a sensation of immersion in a virtual 

A fingertip of a physical hand corresponds to both the environment where the user is able to interact with virtual 

sensing body part (2715) and the physical measured body objects as if he were interacting with physical objects in a 

part (2717). An instrumented glove, optionally comprising a physical environment. 

joint angle sensor and spatial position sensor, produces a 65 Any publication or patent described in the specification is 

physical state signal (2720) corresponding to the position of hereby included by reference as if completely set forth in the 

the physical fingertip. The fingertip position is provided via specification. 
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While the invention has been described with reference to 
specific embodiments, the description is illustrative of the 
invention and is not to be construed as limiting the inven- 
tion. Thus, various modifications and amplifications may 
occur to those skilled in the art without departing from the 5 
true spirit and scope of the invention as defined by the 
appended claims. 

What is claimed is: 

1. An apparatus for providing a tactile sensation to a 
sensing body part in relation to a variable state signal, said 3Q 
apparatus comprising at least one vibrotactile unit, wherein 
each unit comprises: 

means for generating said variable state signal; 

a mass-moving actuator comprising a shaft and an eccen- 
tric mass mounted on said shaft, said mass-moving ^ 
actuator rotating said shaft; 

fastening means for holding said mass-moving actuator in 
relation to said sensing body part for transmitting 
vibrations to said sensing body part; and 

a signal processor for receiving and interpreting said state 20 
signal to produce an activating signal and transmitting 
said activating signal to said mass-moving actuator for 
activating said mass-moving actuator to produce a 
variable tactile sensation in relation to said variable 
state signal as a result of varying the frequency and 25 
amplitude of said vibration. 

2. An apparatus according to claim 1, wherein said 
fastening means comprises a casing containing said vibro- 
tactile unit. 

3. An apparatus according to claim 1, wherein said 30 
activating signal provides varying levels of activating said 
mass-moving actuator for varying the rotation of said shaft. 

4. An apparatus according to claim 1, wherein said 
mass-moving actuator is an electric motor and said appara- 
tus comprises electrical connection means connecting said 3S 
electric motor to said signal processor. 

5. An apparatus according to claim 1, wherein said 
fastening means comprises means for fastening to a portion 
of a hand. 

6. An apparatus according to claim 5, wherein said portion 40 
of a hand is the dorsal side of a finger. 

7. An apparatus according to claim 5, wherein said portion 
of a hand is the metacarpus. 

8. An apparatus according to claim 1, wherein said 
eccentric mass is pie-shaped. 45 

9. An apparatus according to claim 1, comprising a 
plurality of vibrotactile units. 

10. An apparatus according to claim 9, wherein said signal 
processor produces multiple activating signals for individu- 
ally activating each vibrotactile unit of said plurality of 50 
vibrotactile units to produce a complex tactile sensation. 

11. An apparatus for providing a tactile sensation to a 
sensing body part in relation to a variable state of a measured 
body part, said apparatus comprising at least one vibrotactile 
unit, wherein each unit comprises: 5S 

a mass-moving actuator comprising a shaft and an eccen- 
tric mass mounted on said shaft, said mass-moving 
actuator rotating said shaft; and 
fastening means for holding said mass-moving actuator in 
relation to said sensing body part for transmitting 60 
vibrations to said sensing body part; 
wherein said apparatus further comprises: 

a state sensor for measuring the variable state of said 
measured body part and generating a state signal in 
relation to said variable state; and 65 
a signal processor for receiving said state signal to 
produce an activating signal and transmitting said 
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activating signal to said mass-moving actuator for 
activating said mass-moving actuator to produce a 
variable tactile sensation in relation to said variable 
state. 

12. An apparatus according to claim 11, wherein said 
fastening means comprises a casing containing said vibro- 
tactile unit. 

13. An apparatus according to claim 11, wherein said 
activating signal provides varying levels of activating said 
mass-moving actuator for varying the rotation of said shaft. 

14. An apparatus according to claim 13, wherein said 
mass-moving actuator is a variable speed electric motor, 

15. An apparatus according to claim 13, wherein said 
fastening means comprises means for fastening to a portion 
of a hand. 

16. An apparatus according to claim 15, wherein said 
portion of a hand is the dorsal side of a finger. 

17. An apparatus according to claim 15, wherein said 
portion of a hand is the metacarpus. 

18. An apparatus according to claim 11, wherein said 
eccentric mass is pie-shaped. 

19. An apparatus according to claim 11, comprising a 
plurality of vibrotactile units, wherein said signal processor 
produces multiple activating signals for individually acti- 
vating each vibrotactile unit of said plurality of vibrotactile 
units to produce a complex tactile sensation. 

20. An apparatus according to claim 11, wherein said 
apparatus has a plurality of state sensors, each state sensor 
for measuring the state of a different said measured body 
part. 

21. An apparatus for providing a complex tactile sensation 
to a sensing body part in relation to a variable state signal, 
said apparatus comprising at least one vibrotactile unit, 
wherein each unit comprises: 

a mass-moving actuator comprising a shaft and an eccen- 
tric mass mounted on said shaft, said mass-moving 
actuator rotating said shaft; and 

fastening means for holding said mass-moving actuator in 
relation to said sensing body part for transmitting 
vibrations to said sensing body part; 

wherein said apparatus further comprises a signal proces- 
sor for interpreting said state signal to produce an 
activating signal and transmitting said activating signal 
to said mass-moving actuator for activating said mass- 
moving actuator to produce a variable complex tactile 
sensation in relation to said variable state signal. 

22. An apparatus according to claim 21, comprising a 
plurality of vibrotactile units, wherein said signal processor 
produces multiple activating signals for individually acti- 
vating each vibrotactile unit of said plurality of vibrotactile 
units to produce said complex tactile sensation. 

23. Amethod for providing a tactile sensation to a sensing 
body part in relation to a variable state signal, employing an 
apparatus comprising a vibrotactile unit, wherein said vibro- 
tactile unit comprises: 

a mass-moving actuator comprising a shaft and an eccen- 
tric mass mounted on said shaft, said mass-moving 
actuator rotating said shaft; said method comprising: 
mounting said vibrotactile unit on a sensing body part; 
producing said variable state signal in relation to a 

variable condition; 
interpreting said state signal to produce an activating 

signal; and 

transmitting said activating signal to said mass-moving 
actuator for varying the rotation of said shaft to 
provide a tactile sensation to said sensing body part, 
said tactile sensation relating to said state signal as a 
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result of varying the frequency and amplitude of 
vibration of said mass-moving actuator. 
24. A method according to claim 23, wherein said mount- 
ing comprises mounting each of a plurality of vibrotactile 
units on different said sensing body parts; and 


22 


said transmitting comprises transmitting individual acti- 
vating signals to each of said vibrotactile units to 
produce a complex tactile sensation. 
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